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HIGH- INFERENCE BEHAVIORAL RATINGS AS CORRELATES OF 



TEACHING EFFECTIVENESS 



Carolyn M. Evertson and Jere E. Brophy 
The University of Texas at Austin 



The findings reported in this paper are based on data taken from the 
first year of a two-year naturalistic study of elementary teachers selected 
because of their consistency across 3 years In producing student iaarnfng gains 



Of 275 teachers working at grades two and three, 88 second grade and 
77 third grade teachers who had taught at the same grade for 5 years or more 
were Identified. Thus the sample included only experienced teachers. Since the 
district administered the Metropolitan Achievement Tests each fall. It was pos- 
sible to use these data for determining teacher effectiveness. Students' re- 
sidual gains on the subtests of the Metropolitan battery were computed by us- 
ing scores from the beginning of the year as pre-score covariates for adjust- 
ing gains between that testing and the following testing a year later at the 
beginning of the following grade. In addition to computing residual gains by 
using pre-sccres as covariates^ student differences were taken into account by 
separately computing the data for Title I vs. Non-Title I schools, for boys vs, 
girls, and for each of the 3 years separately. Thus, for example^ the formula 
used in computing the residual gain scores for a boy in second grade in a Title I 
school In 1969 was based on the distribution of pre- and post-scores for all 
boys in the second grade in Title I schools in 1969. 

Each student took 3 language arts subtests (word knowledge, word discrim- 
ination, and reading) and either I or 2 arithmetic sijbtests. The number of 
arithmetic subtests available depended upon which Metropolitan battery had been 



on the MetropoJitan Achievement Tests, 
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used and on how the data were recorded in the school records. For example, 
a given child's arithmetic d,*^^ta might contain an arithmetic computation subtest 
only, a combination score ref lecting both computation and reasoning, or 2 separ- 
ate scores, I for computation and I for reasoning. 

Two sets of computations of residual gain scores were made for each 
grade, because of differences in the test batteries used in TItJe I and Non-Title 
I schools. For each of these 4 data sets, residual gain scores were computed 
for each student with In sex and within each of the 3 years on each subtest, using 
the student's pre-score as a covariate. These residual gain scores for students 
were then collated by classroom, and a mean residual gain score was computed for 
each teacher for each subtest for each of the 3 years included in the study 
(Brophy, 1972). 

Many teachers showed constancy across subtests within years as well as 
within subtests across years, so that teachers who produced generally consistent 
gains across subtests and across the two sexes could be identified. The 31 
teachers included in the process observation study the first year (1971-1972) 
were selected from this consistent group. 

The teachers were divided fairly evenly between second and third grade, 
and the socio-economic status of their students ranged from upper middle to 
lower lower class. Several classes had a high concentration of black and Chi- 
cane students. The teacher data included process measures of classroom behavior 
and personality and attitude data from pencil and paper tests. These process 
measures Included both low- i nf erence behavioral observation systems and high- 
inference ratings. Each teacher was observed for 2 mornings and 2 afternoons 
during the spring semester, for a total of about 8 hours. The main low- infer- 
ence coding instrument used w^is ba'^ed on 1he Brophy-Good Dyadic Inleraction 



ERIC 



3 

Sys+ern (tirophy fjrul (iorxJ, 1970). The system allowed for coding such variables 
as teacher vs. student initiation of contacts, types of interactions (academic, 
procedural, or behavioral-discipl inary), difficulty lev^^l of teacher questions, 
quality of student responses, quantity and quality of teacher feedback and eval- 
uative reactions to student response and student work, and the teacher's method 
and general effectiveness in handling c I assroom management and disciplinary 
problems. 

A second coding instrument (created by project staff member Nancy Moore) 
was used on a subsample of 10 teachers (5 high and 5 low effective) who were 
observed twice during group instruction activities. This Instrument was es- 
pecial ly constructed to measure group i nstruction methodolog ica I variables, such 
as lesson composition, sequence, and clarity, teacher questioning patterns, and 
handling of seatwork assignments (see Brophy and Evertson, 1973, for a detailed 
description and discussion of the findings from these systems). 

Teachers were asked to fill out the pencil and paper attitude and person- 
ality measures included in the COMPASS battery developed by the Research and 
Development Center for Teacher Education (Veldman, 1972). These measures dealt 
with levels of teacher concerns about teaching (Fuller, 1969), the teacher's 
overall self-concept and her concept of herseff as a teacher, her coping style, 
other aspects of her personality, and certain demographic data (see Peck and 
Veldman, 1973). 

The high- inference measures to be reported here were chiefly of two types. 
The first was a set of 12 classroom observation scales developed by Emmer (1973) 
from factor-analytic studies of interaction variables common to several of the 
widely used behavioral observation systems. These 5-point rating scales included 
ratings of student attention, teacher enthusiasm, clarity, positive and negative 
affect, task orientation, cognitive level nf questions, student passivity, pupil- 
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pupil interaction^ and percentage of time spent In lectures and demonstrations. 
The scales v/ere marked several times during each of the 4 observations by class- 
room coders who were also using the expanded Brophy-Good System discussed In 
lirophy rjDd l.vorlson (1973). 

Secondly, following their last 2 visits to each teacher's classroom, 
observers filled out 41 high-i nference ratings and 15 high- Inference checklists 
and percentage estimates. Items for these measures were gathered from several 
sources, but most of them dealt with variables which were not covered In the 
low-inference behavioral coding system. Inter-observer agreement on Emmer's 
Classroom Observation Scales ranged from 1?S to 95%, with an average agreement 
of 83^. The ratings agreement ranged from 50^ in one case to 98^, with an average 
agreement of 78^. The raw agreement data are presented In Tables 2 and 4 for the 
check! isfs and percentage estimates. No actual Inter-observer agreement percent- 
ages wore computed for those measures because scorer, would vary depending upon 
the formulas used. It was decided that the raw data give a more accurate picture 
of the real agreement. 

During each classroom observati on, coders also noted the amount of time 
allotted to each subject as well as to sped a 1' activities such as storytelling, 
TV, art, and transitions. The time utilization results are reported in the 
first part of Table 2. 

For the most part, the high-inference measures bore out the findings 
from the low- i nf erence behavioral coding systems (Brophy and Evertson, 1973). 
The correlations reveal several interesting findings. First, with few exceptions, 
significant correlations between process variables and gain scores typically 
involved only one or two of the subtests, despite the fact that teachers had 
been selected because of their general consistency in producinrj student gains 
across all subtests. Thus it appears that certain teacher behaviors are more 
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important for student gain In some subject areas than in others. 

Many variables which correlated significantly with pupil gains In other 
studies did so in this one, but many did not. For example, teacher warmth, cog- 
nitive level of questions, enthusiasm, amount of student talk, peer- tutor i hg, 
solid/irily with ^lurJont*. (rapport), and patience all failed to show significant 
corroloHorr; with ';joirr>. There remains the possibility that some of these 
variables are curvi I Inorir ly related to the criterion, however. Analyses address- 
ing this question are being completed and wIM be summarized in a future re- 
port. 

In addition to correlations across the total sample, analyses were also 
performed separately for Title I (low SES) and Non-Title I (high SES) schools. 

Results 

Data will be discussed within two general categories and grouped within 
calcvjor ies under throe broad headings: I.) variables which pertain to non-aca- 
demic classroom management, control, and organization; 2.) variables which can 
be considered teacher techniques or behaviors In presenting subject matter; 3.) 
st'jdeni variables which are pupil behaviors not under the direct control of the 
teacher. 

The first category will include variabJes which are correlated signifi- 
cantly in the total sample and, either significantly or In the same direction, 
in vsach of the two subgroups (Title I and Non-Title 1). 

Correlations for the Total Group 

A. Classroom manaQement and control (positive relationships) 

1. Room appearance is attractive and uncrowded. 

2. Students are expected to care for their ojvn needs without getting per- 
mission. 
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3. Teacher explains rules or decisions when the reasons for them are not - 
obvious. 

4. Teacher is we I I -organ i zed and we 1 1 -prepared; she is task-oriented and 
doesn't waste time. 

5. Teacher monitors the class regularly, knows what is going on and keeps 
herself aware of events In other parts of the classroom. 

6. Transitions between activities are smooth and efficient with little 
wasted time. 

7. Classroom jobs are determined by some automatic system instead of th3 
teacher's spending a great amount of time deciding who is going to^do 
particular tasks. 

8. A high percentage of teacher structured time in math (correlates 
with both the reading and arithmetic computation subtests). 

B. Classroom management and control (negative relationships) 
I. Chaotic, poorly planned class schedules. 

C. Teacher techniques or methods (positive relationships) 

1. Teacher often addresses problems or questions to the whole class as 
opposed to individuals or subgroups. 

2. Teacher spends a high percentage of time in lectures, answering pupil 
questions, demonstrations, and presenting substantive information to the 
class as opposed to questioning students, giving procedural directions, 
and evaluating (praising and criticizing) student behavior. 

3. Seatwork assignments are appropriate to the task at hand and to the in- 
dividual level of each child. 

4. When a student doesn't understand his seatwork, she asks another child 
to explain r-ither than allowing interruptions in what she is doing, or 
delaying the child in order to explain later. 

5. When helping a child she usually bends close and gets down to his level. 
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6« When a child Is stuck on a word In reading groups she gives him the word. 
7* Teacher uses visual alds> pictures^ and fllmstrlps as materials for free 
time activities. 
D« Teaching techniques or methods (negative relationships) 

J« Teacher's allowing Interruptions while she is working with Individuals 
or group to explain to a chl Id who doesn't understand. 

2. Giving overly long, explicit, repetitive directions. (Possibly over- 
dwelling or needlessly rehashing Information, which most of the class 
already knows, servas to "turn off" or lose students.) 

3. Having books available In the room (not necessarily used). 

4. Asking another child to give the word when a child Is stuck. 

5. A high percentage of teacher structured time. 

6. When a child Is stuck on a word, giving a context clue or deflnitloo. 

E. Student behaviors (positive relationships) 

I. High general level of student attention and a high percentage of students 
attending when lessons are explained or directions given. 

F. Student behaviors (negative relationships) 

1. Copying from a neighbor rather than asking for help when having trouble 
with an assignment. 

2. When students are not working, they are being distracted by activities 
In other groups going on In the room. 

In the second category are those variables v#hlch Were significantly 
correlated with student learning only In one group. 

Correlations In Title I 

A. Classroom management and control (positive relationships) 
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>!.. Keeping child in after school as punishment. 

B. Classroom management and control (negative relationships) 

1. Underreacting to discipline problems so that serious problems go un- 
resolved. (This receives some support from the behavioral data taken 
with the classroom coding system. Thus it seems more important for the 
-teacher to otop firmly any control problems before they get out of hand 
1hon it i'J to critici;!e or punish offenders after the problem or be- 
havior has gotten out of control.) 

2. Allowing 4 or more students up at anytime without permission as long 
as they stay quiet. (It is possible that this is indicative of poor 
classroom control. This lax control could prevent time being spent on 
subject matter. ) 

^3. Having a well-established routine which minimizes interruptions; room 
runs "automatically". 

C. Teacher techniques or methods (positive relationships) 

1. Tenchcr's ability to admit her own mistakes and laugh at herself or 
use the occasion to teach. 

2. Teacher demonstrates showmanship and expressiveness. 

3. Clear explanations. 

4. Having aval lab le^ and using listening centers, aquariums, and other 
"looking" exhibits. 

5. Giving the whole word to a child Instead of a hint or unrelated clue 
when he is stuck during reading group. 

6. Using visual aids (picture files, filmstrips) for free time activities. 

7. A high percentage of teacher structured time spent in reading groups. 
0. Coois to 1he child's desk to give help rather than having child come 
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up to her desk. 

9. When a child doesn't understand his seatwork, teacher asks another child 
to explain. 

Teacher techniques or methods (negative relationships) 

1. Giving a child who is stuck during reading a context clue or definition 
rather than the whole word. 

2. Having either instructional or non- instructional games available in class. 

3. Use of concrete (candy, money) Items, special Jobs, or classmates clap- ' 
ping or cheering as rewards. 

A. Teacher's Identifying with the class and promoting a "we" feeling as 
opposed to standing aloof and separating herself from the class. 

5. Accepting and integrating student ideas instead of rejecting unsoli- 
cited Ideas and sticking with a preplanned fonriat. (This finding is 
borne out to some degree In the behavioral data which shows that for 
Title I, a high proportion of student-Initiated comments vs. teacher 
afforded public response opportunities was negatively related to stu- 
dent learning gains. 5 

6. Gives complete detailed Instructions; prevents errors before they 
happen. 

7. A high percentage of teacher structured time spent in language arts 
and in special activities. 

8. When a child doesn't understand his seatwork, the teacher delays him 
then explains later, if she happens to be busy. 

Student behaviors (positive relationships) 

1. High pupil-pupil interaction which is class relevant. 

2. When students arc not working they are playing as opposed to engaging 
In some other actlvJtles such as daydreaming or disturbing others. 



^. student behaviors (negative relationships) 

1. Student obedience and compliance. (Possibly this variable Is actually 

a measure of teacher punitlveness which does show a negative relationship 
In some of the other data.) 

2. Student daydreaming or getting materials for free time activities when 
not working. 

Correlations in Non-Title I 

A. Classroom management and control (positive relationships) 

1. Punishments for misbehavers Involve discussing the incident with the 
child without scolding as opposed to a more physical means of control. 

2. Before starting a lesson or explanation, teacher says nothing and waits 
for the class to quiet down rather than trying to talk over the noise 
or signaling with a bell or clicker. 

E. Classroom management and control (negative relationships) 

1. "Busy", cluttered classrooms. 

2. Boring, repetitive^ monotonous assignments. 

C. Teaching techniques or methods (positive relationships) 

1. Assigning homework as well as seatwork. 

2. Gaining the whole c I ass V attention before beginning an explanation or 
giving directions. 

3. Having and using science demonstrations or experiments^ 

4. Structured time in Math and Art relates to gains m reading and arith- 
metic computation and reasoning. 

D. Teaching techniques or methods (negative relationships) 

.1. A high percentage of teacher structured time spent in reading groups. 
2. When a child is stuck during reading, teacher asks another child to 
give him the word. 
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Discussion 

In general, it appears that variables which measure control over the 
classroom are positively related to effectiveness. The teacher who is well- 
organized, who monitors the class regularly and nips potentially serious prob- 
lems In the bud, and who has well established routines for handling everyday 
procedural matters tends to be more successful in producing learning gains. 
These data provide strong support for the observations of Kounin (1970). 

It appears that a key factor in effective teaching is organizing the 
classroom environment so that there is maximum opportunity to learn. The daily 
routine and non-academic details are dealt with efficiently and kept to a m?ni- 
mum so that the task of learning can proceed, and this is especially important 
in the low SES schools. For giving directions or explanations there appears 
to be an optimum level of effectiveness. The teacher who dwells too long on 
details or becomes overly repetitive appears to have a detrimental effect, es- 
pecially in the higher SES schools. 

A few variables show significantly positive relationships In one group 
and significantly negative relationships In the other. For example, for Non- 
Title I children, delaying the child who doesn't understand until later when the 
teacher has time to devote to him shows a positive relationship with student gain, 
but in Title I this relationship is negative. Also when a child is <btuck 
Quring a reading turn, for Title I, giving the child a clue unrelated to the 
meaning or sound of the word is negatively related but in Non-Title I the relation- 
ship is positive. A large amount of teacher structured time in reading groups 
appears as positive for Title I, but negative for Non-Title I. 
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Some cautions need to be stressed In interpreting these data, which are 
tentative and in need of replication for several reasons. First, data were based 
on only 2 to 4 observations per teacher. These frequencies are dangerously small 
given the probable day-to-day variation in teacher performance and the effects 
of situational factors such as finishing or beginning a unit, weather conditions, 
etc. Second, the probability data given to indicate the strength of relation- 
ships cannot be taken very seriously because the sample contained only 31 teach- 
ers and over 1000 measures were taken. This obviously violates assumptions un- 
derlying significance tests. Third, partly because of the low number of oppor- 
tunities to observe the teachers, the observers* high-inference checklists and 
ratings show evidence of halo effect and logical error, so that some of the 
variables remain suspect In spite of high inter-observer agreement. Fourth, the 
Pearson r^s reflect only linear relationships and do not take into account pos- 
sible curvilinear relationships between predictors and criteria. We suspect that 
several variables will show such relationships. Fifth, the variances of the 
predictors should be examined, since unusually large or small variances will in- 
crease or minimize the chances for correlation. Sixth, several of the variables 
may be "proxy" variables; i.e., they may correlate with another variable which \s 
the real predictor with the criterion in much the same way as income is correlated 
with education. We are aware that there may be other interpretations of the data 
depending upon one's own persuasion, hence the correlations themselves are pre- 
sented in the tables with a minimum of interpretation. 

Because of the ! imitations mentioned above, and because, even without these 
limitations, the data represent a unique set of findings which are not directly 
comparable to any other data, replication is being carried out with at least 15 
observations per teacher and with some additional information gained in the form 



13 

of a personal interview with each teacher this year. This replication study 
will help determine which of the correlates of teacher effectiveness in producing 
learning gains are genuine and dependable. The correlates that replicate will 
then be experimentally manipulated to establish whether or not they are causally 
effective in producing student learning. 

For other data from the first year's analyses, see Brophy and Evertson 
(1973) and Peck and Veldman ( 1973). 
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Table I. Correlations between Behavior Observation Scales' and Residual Gain Scores 
for Total Oroup, Title I and Non-Titie Schools (decimal points omitted). 

2 

Word Word Arithmetic Arithmetic Rater 
Knok^lcdge Discrimination Reading Computation Reasoning Agreerriont 
lies (N = 31) (N = 31) (N = 31) (N = 31) (N = 22) 



Total Total Total Total Total 

Tl NT Tl NT Tl NT Tl NT Tl NT 



High Level of Student 



Attention 21 19 32" 25 15 88 

- 02 23 17 10 20 27 17 30 33 14 
Teacher Often Addresses 

Questions or Problems 

to the Whole Class 22 36«» 08 -09 -04 77 

01 21 29 31 - 36 06 - 19 - 09 -50 -03 

Teacher Is Task 
Oriented, Doesn't 

Waste Time 27 30» 3I« 15 08 83 

28 21 47 12 17 24 16 14 23 06 

F requent Pup I l-to-PupI I 
Interaction (Class 

Relevant) - 02 -22 II 20 

- 10 00 - 35 - 17 34 07 59** 05 17 16 

% of Tifne Teacher 
Lectures or Demon- 
strates 36*» 40»" 19 13 II 89 

36 33 22 4! - 10 21 30 03 50 07 

Negative Affect: 

Criticism Hostllitv -12 -22 -18 -06 01 83 

uriTicJsm, MOSTiiiTy |'|^_,e - % _ |4 _09 -15 15 -21 14 01 

PoGftive Affect: 

Pra-se, Support II 10 09 16 04 86 

-12 08 28 -15 -05 -06 -06 27 -56 06 

Requires High Level of 

Generalization, Infor- 

enco, or Explanation 21 25 21 -07 - 04 83 

23 15 39 04 '-24 19 06 -12 -31 -05 

O 
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9. Hfph Student With- 
drawal, Passivity, or 
Aimless or Repeti- 
tive Behavior - 13 

25 -18 

10. Clarity: Students Show 

Clear Understanding 
of Teacher Presenta- 
tions 

11. Enthusiasm: Teacher 

Shows Enthusiasm, 

•~xc I tement, Enjoy- 

inent -03 

-20 -13 
2. Convergent QuestJon- 

fnq: Most Questions 

Have Clodr-Cut Correct 



20 

-05 24 



finswers 



II 



25 

28 



- II 

09 00 



16 

17 05 



-04 

15 -38 



19 

18 18 



16 



-21 -10 -04 75 

20 -19 -08 -10 -51 .05 



24 19 15 

04 23 14 23 60* II 



66 



05 01 -09 95 

08 -20 -02 -01 -70-10 



-02 - 05 05 72 

16 -10 -16 -0! 25 03 



5-Point scales rated f ntormj ttently during each visit and averaged across obsorverF, 



% ntirpotrtoni within I point by two Independent raters. 
* p < . 10 
■"p < .05 
'"p^.OI 
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Table 2. Correlations befxeen Teacher DehavJor Checklist Variables' and RosJdual GaJn 
Scores for Total Group, Title 1 and Non-Titte Schools (decimal points omit+ed). 



Checkl 1st Variables 



Word Word Arithmetic Arithmetic Rater 

Knowledge Discrimination Reading Computation Reasoning AgreeiTient 
(N=27-30) (N=27-30) «N=27-30) (N=27-30) (N= 19-21) 



Total 
Tl NT 



Total 
Tl NT 



A. Methods of Handling Catch-Up Worit 
I . No Remediation; 



Chi Id Skips Missed 

Work -07 

-09 - 

2. Chi Id Must Make Up 

Work but Is Not 
Given Help -03 

3. Teacher Explains 
Work and Has Chi Id 
Do Part of It. 



-09 

-03 



07 



25 



07 



26 
16 09 



18 
24 



-07 



4. Another Chi Id Is 



04 

13 



Assigned to Help 11 

13 - 

5. Chi Id Put in Slower 

Group Temporarily -13 
-27 - 

6. Other -03 

00 - 

6. Rules Regarding Physical Movement 
I. Must Always Get 
Permission to 



-21 
-33 
-17 
-25 



Leave Seat 
2. One at a Time 
Without Per- 



mission 



06 

33 -01 



16 

16 



29 



35» 
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60«*» 

69*** 



Total 
Tl NT 



Total 
Tl NT 



04 



26 



-07 



07 



17 

24 03 



15 



31 



-13 
-18 - 

-02 
07 - 



05 



17 



3I« 

32 



M 

20 



-01 



15 



19 

33 



14 

35 



18 

31 
21 
37 



-02 



09 



19 



25 



31 



Total 
Tl NT 



-02 
-II - 



-13 



08 



-07 



-19 



-04 
-21 

07 
33 



-21 



09 
14 



12 



27 



28 



Both One None 



108 



104 



113 96 



104 



I 

0 



0 
I 



109 
109 



10 97 



108 



3. As Many as 4 or 
5 Without Per- 



mission 04 


04 




-08 


-33« 


-10 


0 


r 


104 


-10 30 


04 


26 


-22 20 


-6I*« - 


-76 08 








4. Cen Go Quietly to 
















Specified Places 


















without Permission 


















at Any Time 02 


-16 




06 


OS 


-03 


23 


20 


66 


-50* 15 


-29 


-29 


-20 06 


06 12 


47 - 








*>. No Restrictions 06 


05 




-03 


03 


01 


4 


12 


93 


42 --03 


29 


06 


29 -10 


34 -28 


70 -14 








6^ Some Children 


* 








t 








>ri ■ 1 wffTww 1 ■ wo 


















Movement but 


















not Others -25 


-18 




-22 


07 


-03 


\ 


1 


U>7 


-27 -26 


-33 


-10 


-18 -25 


31 -II 


-21 - 








7 - On 1 V Man i +or<i 










• 








A] Inw^H Pr^A 


















Movement 07 


-03 




13 


IS 


— 


0 


I 


106 


26 


04 




43 - 


26 - 










B. Other -39** 


-34" 


-27 


-27 


-37» 


1 


3 


105 


- 43 --49 


-45 


-27 


-23 -34 


-23 -35 


-39 








C Pon I shanpnt<5 U^Ad bv Teachdr 


















i . Stav after 


















School 07 


07 




30» 


16 


13 


5 


5 


96 


28 - 


22 


01 


78«* II 


33 01 


16 16 








2. Spankfnq 19 


II 




-07 


-05 


02 


1 


3 


105 


54 09 


30 


to 


-09 09 


07 01 


14 - 








3. Wrlt/na Sentancss 


















on Board 






— 


— 


— 


0 


0 


109 


4. Isolation within 


















the cf ass room 10 


iO 




12 


01 


-04 


4 


14 


91 


27 03 


09 


09 


37 -02 


01 01 


06 -05 








5. Removal from the 


















C(ossroom -06 


-If 




-06 


-09 


-02 


9 


7 


93 


21 -16 


-04 


-13 


24 -17 


-05 -II 


21 -07 








6, Mote to Parents 10 


12 




II 


01 




0 


1 


ice 


09 




fO 


09 


01 


M mm 








7. Send to Prlnclpal-05 


00 




-II 


00 


01 


5 


4 


102 


^ 18 -II 


-07 


-02 


-30 -10 


•5 -06 


-07 03 
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b. Extra Read! no. Math, 

Etc. Work >20 -03 -09 15 II 0 5 104 

-27 -23 -33 -03 -18 -14 31 M -21 13 

9. Peer Pressure (e.g. 

"You lost the race 

for your group.") 08 -05 09 03 07 I 15 95 

33 -03 -05 -16 -25 08 24 02 18 01 

10. Scolding -09 00 03 13 16 12 23 74 

02 -II -13 24 30 01 37 -07 57 13 

I ! . Discussion of 
Incident (No 

Scolding) 16 -05 22 02 21 8 i4 87 

-25 38 -08 -04 - 37 -30 31 -80 44* 
12. Other 23 08 32* 10 09 I 13 95 

21 20 08 01 22 29 05 12 -41 13 

}» Rewards Used by Teacher 

1. Classmates Clap i 

or Cheer -06 08 -02 -23 -29 3 16 90 

-41 03 -18 16 -24 02 -31 -19 -8l**-24 

2. Special Privileges -08 -12 W 06 -(I 0 7 102 

26 -27 04 -31 43 -02 26 -09 - -13 

3. Waiver or Reduction 

of Assignments -35* -19 -15 -29 -51 •» 0 1 108 

-41 - -27 - -21 - -37 - -53»* 

4. Symbols (Stars, 
Smiling Faces, 

etc.) 00 -02 -13 03 -16 3 . 13 93 

21 -08 30 -19 10 -24 31 -14 27 -21 

5. Token Redeemable 

for other Rewards 00 -10 -01 12 13 2 I 106 

-03 - -19 - -08 -15 - 14 

6. (Concrete (Candy, 

» 

Money, Prizes) -06 -19 -19 .13 10 0 3 106 

-40 16 -59* 17 -35 -06 08 20 -21 |9 

7. Jobs (Monitor, 
Helper* Clean 

Erasers) 07 06 14 CO 09 2 9 102 

03 10 -06 22 22 14 -06 05 -85* 21 

8. Public Recognition 

(Gats to Read or 

Work Problem on 17 II 26 -II 07 8 IC 85 

O 09 18 -00 15 -26 40 -39 03 -26 10 



ERIC<3> 



20 

0. 01hcr * -13 -f5 -24 -fO 05 0 6 101 

-36 16 -22 f 7 -31 -06 -29 20 -30 19 

L". Appropriateness of AssJgnmonts 

1. Too Short or 

Easy -23 -16 -06 -03 -09 13 18 77 

-36 -16 -23 ' -02 18 -II 27 -35 54 -31 

2. Boring, Repltl- 

tive, Monotonous -24 -04 -20 -13 -15 7 20 81 

27 -45* 30 -05 29 -33 08 -33 02 -23 

3. Too Hard: Students 

Can't Get Started 
or Continual ly 

Need Help -11 -15 -21 00 -02 3 17 88 

03 -13 -03 -07 -06 -19 02 - -71 10 

4. Continues Acti- 
vity Too Long, 
until They Get 

Boring -27 -22 -24 -10 -05 5 17 86 

-15 -30 -25 -12 -09 -23 16 -26 -20 -04 

5. No Inappropriate 

Asslqnments 30 22 40** 34* 25 II 17 80 

04 35 08 13 20 40 28 4<» -41 33 

. Distractions: What Do Students Do When not Working? 

1. Use Washroom 06 -10 -01 -02 -23 14 18 76 

39 -03 17 -19 22 -04 32 -29 -17 -27 

2. Repeatedly Get 
SuppI ies tor Free 

Time Activities -05 -16 -05 03 13 6 10 92 

-35 08 -59»*M -21 07 08 -01 05 17 

3. Watch Reading Group 





or other Activity 


-35»» 


01 




-34* 


-41** 


-33 




3 


20 


85 






-42 -33 


-18 


12 


-27 -35 


-31 -46* 


-21 


-34 








4. 


Talk 


10 


-08 




07 


-13 


-04 




33 


20 


55 


5. 


Play 


00 


-23 




-02 


16 


15 




12 


20 


76 






01 09 


-36 


-03 


21 


39 01 


82** 


13 








6. 


Daydream 


-16 


-25 




-24 


-15 


03 




II 


19 


78 






-24 -09 


-34 


-II 


-49 -OA 


-48* M 


-58 


16 








7. 


Ask for Help or 























Look More Closely 

Work on Board 03 -07 17 22 2$ 6 18 84 

ERfc - 06 -12 -0( 30 17 45 09 34 26 



21 



J. Disrupt c^ho^ 

Slodents 
). Oir«cr 

StHdfint AMltucfuG lo/ord tho Tcachor 
V/hon Havlnq Trouble 
Studonta Concentrate 



-03 

08 -08 
-19 

26 -38 



-09 

-12 -08 
-17 

-19 -07 



or Seek Help -,13 

-II -19 
When Havlncj Trouble, 

Students Merely Copy 



from /Neighbor 
S. Students 'Work as 
Wcl f When not 
V/atchod as V/hen 
Watched 
I. Students "Act Up" 
When Unwatchsd 
Students Seom 
Aftiused by 
Teacher 

Students Seem to 
Fear Teacher 
Students Seom to 



-20 

-66***- 10 -68***- 10 



-09 

06 -27 



-37» 



09 

-26 17 



-06 

04 -05 



12 

-02 09 



-19 

-36 -01 



-06 

16 -13 



10 

29 08 



Respect Teacher <5 

23 



02 



04 

15 



21 

19 



16 

43 



02 



43* 



-17 



.08 

-01 -13 

-23 -40 



00 -04 

-03^ 02 -17^ -03 

-19 -20 

29 -59*«* 18 -32 



02 

25 -15 



-21 

-14 -14 



-06 

13 -24 



-10 

-16 -06 



25 

-03 31 



-05 

22 -07 



13 

•07 25 



07 

22 



-03 



02 

30 -07 



22 
67***05 

01 

-29 -01 



Prco Time Materials Available (Not Necessarily Used) 
. Oooks 

. Loarnlng Centers 



21 

31 14 
-08 

-30 07 



-25 -09 
-10 -45* -01 -25 



-34« 
-28 -54** 



(Any) 
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M 

-03 06 



19 

08 



09 



19 

17 06 



-05 

-38 09 



-17 

•12 -20 



-05 

-43 



23 

-59 35 



07 

48 05 



19 06 

20 04 02 10 



2t 

48 21 

-04 

-62 04 



-32«» -39» 
-38 -30 -53 -46* 



07 

-22 12 



15 19 74 
0 7 101 



15 30 62 



8 16 81 



n 16 76 



\l 18 76 



4 8 93 



0 5 100 



28 12 65 



41 16 45 



9 21 72 
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3. Lisloninq Centers -02 
A. Vi;.ual (P I dure 

Files, Fi Imstr(p5)07 
5. Sclenco Oemonstra- 



-01 

18 



15 

43 



-13 



-04 



tlons or Experi- 
ments 
6. Other Learning 
Centers 



15 

08 



18 
16 



14 



18 



01 

-20 02 



7, Coloring Pictures 03 

-26 15 

8. Painting, Art 



-04 

-13 
-23 
-30 



-02 
-19 



Act I V 1 1 i so 

9. oames (Any) 

10. Instructional 
Games 

1 1 . Non- instruc- 
tional Games 

12. Aquarium, other 



-20 

-12 -25 

-03 
-43 05 



-16 
-56»*-06 



-13 
-51* -01 



-35 



-29 
-22 
-04 

-30 -03 



-24 

-45 -21 



-2\ 

-38 -14 



Lookinq Exhibits 02 

39-11 



03 
34 



-13 



I. Free Time Materials Observed In Use 
I. Books 



10 

12 06 



19 

34 04 



2. Learning Centers 
{Any) 



20 

-06 20 

3. Listening Centers 09 

04 08 

4. Visual (Picture 

Files, FI Imstrlp5)40** 
58«*»33 

5. Scloncn Oemonstra- 



-03 



-16 



tlons or Expori- 
incnts 



ERIC 



3I» 

-09 35 



II 

16 

-03 
16 

28 

31 20 



20 

-03 14 



CO -21 -26 19 14 69 

28 -14 -29 -16 -01 -33 

02 -08 -10 A 19 79 

18 -14 31 -25 56 -16 



10 -04 00 5 16 81 
15 -02 07 -14 - -.01 

-02 12 21 19 92 

-25 04 -02 19 28 21 , 

11 08 01 7 27 68 

01 17 08 07 -13 04 

-II -09 -29 8 19 75 

33 -33 .21 -34 -07 -35 

-02 -06 -08 14 22 66 

-19 -05 -27 04 -09 -08 



-10 -10 -08 23 18 61 

-09 -18 -45 14 -54 -02 



-15 -06 - »4 24 u4 

13 -16 -37 13 -21 03 

-15 ,-20 00 IB 16 68 

10 -17 -28 -14 -03 01 



-08 -27 -20 

-01 -21 -37 -23 -28 -21 



25 16 61 



28 02 10 4 15 83 

31 19 -34 12 -36 14 „ 

19 -07 -28 9 17 76 

60** 02 - -II -04 -31 

26 16 13 3 M 85 

16 23 22 13 38 II 



29 09 16 ' 0 15 C7 

-35 32 -25 21 - IB 



23 



6. Other Loarning 



Centers 19 -05 01 (2 24 1 10 91 

16 20 -13 -04 -25 08 -02 20 28 24 

7. Coloring Pictures 13 -II 09 00 03 5 23 74 

-24 30 -26 -02 -13 21 -12 08 -47, 13 

6. Palntinq, Art 

Activities -II -16 01 -05 -27 5 15 82 

-02 -16 -04 -27 37 -19 29 -32 -07 -36 

9. Games (Any) -02 -14 01 -06 -08 6 23 73 

-44 II -26 -13 -1) 02 -21 03 -12 -08 

10. Instructional 

Games -01 -12 13 03 -10 12 IC 74 

-32 OB -06 -19 45 -02 -08 10 -54 -04 

11. Non- Instructional 

Games -06 -16 -03 -05 -06 12 19 71 

-38 07 -26 -II 03 -05 -23 10 -06 -07 

17:, Aquariums 7 Other 

Looking Exhibits II 12 12 -14 -07 4 13 66 

42 02 70**»-IO 26 -01 -II 19 06 -08 

. Use of Peer Tutoring -II -12 -02 -09 -14 7 15 87 

Assigns Homework besides Seatwork 

23 13 34» 19 08 4 23 82 

-26 38 -29 25 -04 46» 19 19 -32 i3 
. Teacher Sometimes Underreacts to Control Problems, so Serious Problems Go Unrosotved 

-13 -07 -II 03 05 6 13 90 

-35 -06 -52* 21 -12 -12 17 -09 05 06 



i 

Each of two observers completed the checklists twice; scores obtained by summing. 

2 

These are the raw rater agreement data: "Both" means that bot!? observers checked 
the Item; "One" means that one checked the Item and one did not; "None" means that 
neither checked the Item. Minor differences In the totals occur because observers 
occasionally felt or^pletety unable to rate on a given item. 

• P<.IO 

•J -» < .OS 



Table 3. Correlations between H(gh-I 
Total Group, Title 1 and Non 
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nferencG Ratings' and Residual Gain Scores for 
-Title Schools (decimal points omitted). 




Word 


Word 






Arithmetic 


Arithmetic 


l^ter 


- 


Knowledge Discrimination Reading 


Computation Reasoning 




Ratinps Variables 


(N= 


24-28) 


(N=24-2e) 


(N=24-28)(N=24-28) 


<N= 18-20) 




l« Typical Affec- 


Total 
Tl NT 


Total 
Tl NT 


Total 
Tl NT 


Total 
Tl NT 


Total 
Tl NT 




tlonateness 


















Level 
2a. tAost Intense 


26 
-21 


42 


14 

-01 


19 


14 


21 


li 

-49 17 


86 


Affection Ex- 


















pression Ob- 


















served 
2b. Most Intense Neg 


U 
-52 


44 


01 

-40 


16 


22 

— U«t 


28 


14 

-53 22 


90 


ative Affect Ob- 


















served 
3. Sol Idarity with 


-17 
II 


18 


-18 

37 


00 


-06 
-1 OB 


-06 

-28 42 


-15 

-61 24 


75 


Class: Teacher 


















Identifies, Pro- 


















motes "We" Feel- 


















ing 

4. Patient end Sup- 


22 
-25 


39 


16 

15 


08 


16 

-05 14 


01 

-34 28 


06 

-83**20 


84 


portive When Cor- 


















rect I ng 
5» Students Al lowed 


20 
-14 


52 


04 

1 1 


-15 


10 

-25 14 


-03 

-28 15 


03 

-5i -08 


66 


Choice In Asslgn- 


















rrvants 
6, A :cepts Student 


-01 

16 


-14 


00 

31 


-22 


>06 

33 -33 


-20 

-22 -26 


-24 

21 -37 


82 




















q rates thorn Into 


04 
-16 

• ■ 


08 


06 
18 


-13 


09 

06 -04 


-13 

-20 -16 


-21 

-84* -28 


79 



38»» 

.25 47» 



7. Admits 0»/n Mis- 
takes; Laufihs at 
Self or Usos Oc- 
casion to Teach 

or Mot i vate 04 
AA 

8. Usual I V Bends Close, 
Gets Down to Chi Id's 
Level 

9. Goes to Seats to 

Chock Work; Doesn't 

Stay at Desk -03 

-33 01 

10. Usually Speaks to 
Individuals rather 

than Whole Class -13 

-13 -22 

I I . Uses Advance Orcjan- 
izers in Introducing 
Activities 

12. Gives Complete, 
Oetai led Instruc- 
tions; Prevents 
errors before they 

Happen 32* 

01 36 

13. Students Eager to 

Respond; Uo Fear 17 

27 03 
M. Teacher vJalts Pa- 



12 

-17 78«««-30 



30 
-01 39 



28 
46 



II 



-12 

-12 -20 



-04 

-20 -01 



19 

14 



15 



20 

33 02 



24 

32 



1 1 



25 



-09 -26 -19 84 

-02 -23 -34 -22 34 -30 



20 
-10 30 



22 

2i 16 



12 

-44 18 



27 

14 20 



-04 

-35 24 



-13 

-06 -25 



14 71 

-31 24 



-14 83 

-53 -14 



06 14 02 84 

I -04 35 -12 -26 02 



if 03 

■37 22 -23 18 



02 71 

-73 13 



-17 
-72»»»I3 

19 

15 15 



04 

-59 10 

02 
07 -02 



67 



66 



ticntjy If Student 
!>icsn't Respond 
Promptly 



13 

21 06 



ERIC 



02 

AA 



-31 



-01 -15 -13 

-25 01 -34 -03 -G7 -13 



73 



12 

13 -13 



10 

34 26 



(15. Non-Competlttve Atmo- 
sphere; No Stqns of 
Eaqerness to See 
Others Fa 1 1 
|I6. Students Allowed to 
Work in Cooporntfvo 
(Jroupr. 

[17, Teacher Recognizes 
Good Thinking Even 
When It Doesn't Lead 
to "Right" Answers 

ii 

14 

16. Democratic Leader- 
ship Style: Students 
Share In Planning 
jnd Decision Making 



02 



16 



20 

02 

19. Few Restrictions on 

students During •? 

Seatwork Periods lO 

-02 34 

20. Students Expected 
to Care for Needs 
Without Getting 
Permission 38** 

21. Teacher Concerned 
with Substantive \ 
Content, not Form, - 
of Student Responses 



22 41 



ERIC 



-20 

01 -24 



-07 

-20 00 



-07 

29 



09 

26 



-06 

02 



15 
29 



'41 



-16 



00 



-01 



08 -06- 
51 -10 33 -31 



-19 -06 -17 

03 -10 16 -22 n -27 



15 00 17 

27 14 -12 10 -47 24 



03 -IS -22 

-04 -n -26 -23 -46 -26 



25 
07 14 



08 
19 21 



-07 

-03 -23 



08 

23 -05 



-17 

-63 -25 



01 

30 -02 



29 17 26 

26 21 13 15 57 22 



-10 23 14 

08 -15 47 -01 62 05 



27 



22. Teacher Stresses 
Factual Realism, Re- 
jects or Corrects 

• . ■ * 

Childish Idealism 06 -07 -10 -17 -16 86 

26 -04 40 -28 00 -20 -40 -04 -36 -f9 

23. Teacher Crodlblllty: 

Sludontf. Seom to 
Cellovo and Kcspect 

Teacher 20 II 16 09 04 76 

-08 27 17 -01 -16 19 -17 27 -61 12 

24. Showmanship: Teacher 

Is Melodramatic, Ex- 
pressive, Giishy, 

tfnotlve -II C9 -07 24 04 60 

-IB -15 -15 15 30 -30 58»» -02 19 02 

25. Teacher Gets <itten- 

tion before Start- 
Inq, Doesn't Try to 

lalk over Uin. 30 27 32» -01 00 82 

!V 33 41 10 -05 45» -30 20 -66 07 

26. Chaotic, Unplanned, 

Poorly Scheduled -25 -3e»* -20 05 -24 73 

-33 -22 -48 -33 12 -42 46 -48* 20 -49» 

27. Teacher Seems Con- 
fident, Self -Assured 

22 II 02 06 -04 90 

A2 14 44 -07 -12 07 05 06 03 -07 

28. Politeness: Teacher 

Hequlorly Says "Please," 

"Thank You," etc. 02 00 02 00 -02 93 

OZ -03 29 -26 II -12 -15 12 -43 02 
2-1. Hlr|h Concorn about" 

Nchlevement 23 15 09 -05 -07 88 

16 19 31 -06 -24 07 -31 08 -61 00 

50. Room Is Attroc- 

Mv© 44«» 35* 32» 04 11 74 

O . 36 45* 55* 14 34 17 -10 05 08 10 



ERIC 



31, Toachor Gives Much 
Encouragement to 
Students 



05 

-16 04 



32. Room Is Uncrowded 



45 V)*' 



When RooGono Aren't 
Obvious 



40"* 

32 41 



34. Teacher Woi I Or- 



fianlzed. Prepared 46*** 
50 42 
35. Teacher Reqularly 

Monitors Class, 

Knows What's Goinq 



on 



35» 

34 31 



3f.. '"imoolfi. Lfflcieni 
1 ranr. itioris. Little 
Tlrne Was ted 

37. Cor* i tors Determined 
"Autf^tical ly" 
by a SvsTenatic 
Procedure 

30. "tJiisy,"' Cluttered 
f.iaosroom 



50 47» 



37« 

41 29 



-02 
-26 - 

VI, Stud«fn1', Compliant, 

(»l><:di«'nt 27 

-04 36 
■40. Teacher fiivcs Overly 

Explicit, Ropotl- 
t^v« 0 i rot, i \ <jf fj - 1 2 



05 

24 -28 

40* » 

21 41 
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50 

53* 07 



32« 

55" 09 



32« 

53* 08 



36«» 

64«» 15 



37" 

56** 16 



05 

03 -07 



23 

24 10 



00 



-0/ -?! <1 -13 



II -07 

06 -09 -26 03 



19 

-08 18 



21 

-21 25 



23 

-04 20 



35* 

08 37 



41 44* 



12 

22 -13 



02 

-25 16 



-03 

-47 27 



00 

-25 14 



13 

-08 25 



27 
12 



53 



-20 

-16 -43* 



23 12 

19 33 -21 34 



-23 -53*'* 
03 -'A** '0'/"'ir 



06 

-64 10 



14 

-36 25 



00 

-40 04 



14 

-24 19 



18 

36 16 



-09 

10 -25 



09 

-64**20 



-37* 

-50 -"15 



28 



-08 66 

-52 -08 



53»»« 46»»* 43»* 74 

03 62**» 40 50** 60 48* 



87 



64 



06 



70 



74 



86 



94 



74 



29 



41 . Wei I FstabI iohcd 
Rrnitinos Minimize 
I ntorrupt Ions; Room 
Hons "Automatically" 

29 22 27 06 OB 62 

"01 34 32 07 -01 26 -27 25 -83*«I7 



1 ' 

First three scales have 13 points; all ethers have 5. Scores obtalnsd by sum- 

siiriq across two raters. 
7 

i Arjreomont across rator pairs; within two points on first three scales, within 
ono >oifit on all oVhers. 
• p < .10 
P <; .05 
p < .01 
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Table 4. Correlations between Percentage Estimate Variables I and Residual Gain Scores 
for Total Group, TTiitle I and Non-Title Schools (decimal points omitted). 







Mord 


Word DIs- 




Arlth. 


Arlth. 


Rater' 






Know- 


CP Irnf fia— 

Wl i III 1 1 1 o 




wwiiiwu 1 a 


Pax con« 


An y^r>rr 

Ay ree— 






ledge 


tlon 


Ing 


tlon 


Ing 


ment 


Percentaqe Estimate Variables 


(N=22-3I) 


(N=22-3l ) 


(N=22-3I > 


(N=22-3I) 


(N= 15-22) 








Total 


Total 


Total 


Total 


Total 


SON 






Tl NT 


Tl NT 


Tl NT 


Tl NT 


Tl NT 


one 

ft ® 2 


A. Time Utilization^ 
















1. % Total Time Structured by 














Teacher 




-09 


09 


-30 


-21 


-16 


«W ' — M 


2, ^Structured Time 


In Lang- 




IS 03 


-10 -43* 


-09 -30 

W ^w 


-02 -20 




uage Arts 




-04 


-08 


02 


03 


17 


«W — • W« 


3, % Structured Time In 


-50* 14 


-34 07 


-26 17 


-15 15 


-06 21 




M -rh 


















24 


05 


36 


32 


25 




4, % Structured Time 


in 


!3 25 


-10 -08 


2f 34 


25 44* 


36 29 




Art 


















X 


12 


43 


25 


45 




5, % Structured Time 


In Spell- 


-04 39 


-25 24 


-09 58**^ 


07 34 


42 46* 

^ A ^W 




Ing 




-01 


SO 


-10 


-13 


-21 




6. % Structured Time 


in Read- 




-OB 15 


-21 -11 


17 -"ifi 


01 -VI 




ing Groups 




-16 


-09 


-22 


-05 


-33 




7. % Structureo Time 


in 


3B -33 






52*-42* 






Soc?al Studies 




-05 


09 


04 


01 


01 


•— •— — 


8. % Structured Time 


In Tran- 


-•05 -10 


10 01 


26 -09 


-4^ 14 


05 




S It? OPS 




09 


03 


-05 


-01 


J2 - 




9. % Sfnjcfured T?me 


In 




-08 \'\ 


— AH WW 


«1^ 1 1 






Morning Routine 




-09 


-14 


-03 


02 


-17 - 




10, % Structured Time 


in 


02 -13 


-26 -08 


13 -09 


32 -19 


28 -27 




Specfal Activities 


-09 




-25 


-29 


-12 








-03 -OB 


02 04 


-19 -23 


-59**02 


-48 -06 




8. Itethods Used to Cat 


J for Attention 












f. Says Nothing, Waits for 














Quiet 




19 


29 


25 


-09 


-03 21 6 15 


2. Paps Desk Lightly, 


Uses 


-05 27 


22 26 


-27 45* 


-49 17 


-77 ■ 07 




Norma! Voice 




05 


08 


15 


20 


22 


1 6 35 


3. Gimmick (light flJcK^ bell. 


-35 31 


-07 26 


27 13 


16 26 

1 w AW 


-05 25 




clicker) 




-25 


-10 


-29 


-20 


-17 


5 8 39 


4. Raises Voico Over 


the 


09 -36 


-J4 -2? 


06 -46 


34 -34 


33 -19 




Din 




-14 


-26 


-18 


08 


14 22 ;2 C 






-25 -06 


-32 -M 


-17 -1 1 


07 12 


68 10 





9. Raises Voice and Singles 
Out Individuals 

6, Shouts, Becomes Angry, or 
Scolds Class 

7. Shouts, Becomes Angry, or 
Scolds Individuals 

6, Whispers or Speaks Softly to 

Nearby Pupils (at first) 

9. Other (includes any method 

not listed above) 09 

-03 12 

C. Estimated Jf of Students Paying Attention^ 

18 
13 16 



-06 
-03 -07 

03 
42 -15 

-07 
40 -30 

15 
31 15 



-05 
-07 -03 

-09 
06 -02 

-12 

04 -13 

23 
38 27 

-12 

-19 -10 



23 
47»-01 



-06 
-12 -02 

02 
45 -15 

-12 

23 -27 

10 
29 06 

05 
41 -05 



23 
08 21 



-14 

-17 -12 

17 
39 -09 

10 

36 -16 

21 
27 19 

17 
42 07 



03 
-23 21 



-07 12 23 17 
38 -12 

04 5 5 42 

32 — 

-02 5 6 41 

20 -07 

12 0 5 47 
— 12 

10 3 12 37 
57 07 



07 50 0 0 
-25 15 



0. What Does the Teacher Do When a Child Doesn't Understand? 

1. Stops What She's Doing, 
Explains 

2. Delays Child then Explains 

Later 

3. Delays, but then Fails to 
Follow Up 

4. Asks Another Child to 
Explain 

5. Scolds Child for fJot 
Understanding 

6. Encourages Child but Give 
No Help 

7. Refuses Help ("You're on 
your own.") 

8. Sends Child to Aide or 
other Adult 

9. Other (includes any method 
not I isted above. ) 

E. Teacher Goes to Child's Desk to Give Help, Doesn't Stay at Desk 

19 28 08 22 

45 09 39 20 26 -03 53« 02 



ERIC 



-16 
-32 -16 


-02 
01 -11 


-24 
-55»»-22 


-45** 
-58» -41 


-45 »• 
-43 -49» 


29 

-66* 52*» 


03 
-44 17 


20 
-41 36 


1 1 

-42 35 


39» 
-53 46* 


-23 

-30 -20 


-13 

-23 -07 


-15 

03 -20 


05 
33 -11 


03 

20 02 


17 
58»«-02 


4I»« 

59*» 27 


21 
17 18 


03 
06 01 


II 

83*'^ 03 


-01 

26 -17 


-13 

-05 -02 


06 
47«»-08 


16 
33 -03 


03 
03 07 


-20 
-06 -31 


-15 

-08 -22 


08 
34- -08 


22 
31 16 


-05 
-10 -04 


08 
51»-13 


-03 
10 -04 


04 

35 -08 


22 
26 25 


16 
21 19 


-01 

09 -07 


08 
28 -01 


-04 
-06 20 


07 
08 17 


15 
55 11 


,09 
-12 -08 


-34» 

-38 -38 


-13 

-02 -23 


25 
48 •-02 


-02 
23 -18 



15 50 0 0 
67 09 



F« Mh^it Todcher Does Whan Child Is Stuck While Reading In Reading Group 



1. 


Glv«s Word 


11 


Ql 


13 


34» 


35 26 


3 0 


2. 


6Iv«s First Sound or 


12 17 


-10 16 


-08 31 


29 40 


79«' 34 






Syllabre 


10 


01 


03 


08 


-08 12 


9 8 


3. 


Child Starts Sentence or 


11 06 


36 -21 


17 -09 


-06 14 


-67 -03 






Paragraph Over 


19 


-07 


-09 


01 


09 • 0 


12 17 






18 22 


-10 -05 


-37 02 


-13 09 


19 09 




4. 


Gives Context Clue or 
















Definition. 


-2* 


-09 


-23 


-39»» 


-29 4 


5 20 


5. 


Asks Another Child to 


-30 -23 


-20 -04 


-12 -29 


-17 -52«« 


-94««»-22 






Give Word 


-32* 


04 


-26 


-48»» 


-5I»» IS 


7 7 


6. 


Gives Clue Unrelated to SounJ^* 


-07 00 


-13 -40 


-29 -61*»» 


-02 -56** 






or Meaning ("It's one of 
















our new words.") 


30 


04 . 


3'.» 


09 


26 1 


7 21 


7. 


Tails Child to Skip, Go 


-40 45* 


-36 18 


-10 46» 


-21 21 


-95»«« 35 






to Next Word 


-26 


— 1 7 
•1 / 


•III 


13 






e. 


Other (Includes any method 


-22 -30 


-27 -13 


-03 -13 


34 00 


-20 06 






not 1 Is ted afcove) 


03 


08 




-03 


01 0 


2 27 






18 ~ 


28 ~ 


63»» — 


-02 — 


06 «- 





Two observers estimated percentages for each appropriate category; scores obtained 
by averaging. 

^These are the raw rater agreement data: '*Both" means that both observers enterec^ 
a J >0 on the Item; ''One" rneans that one entered q % > 0 and the other entered "0;*' 
"No^ie" cleans that both observers entered "0/* Differences in totals occur because observers 
were not always able to estimate with any confidence. 

"'rimo utilization daf^ were computed from Information on the classroom coding sheets 
concerning the starting and endfng of activities. Reliability coefficients were not com- 
puted here because agreement was near-perfect; minor differences were handled by aver-- 

aging across observers. 
4 

Pearson £ was computed for this variable, since both observers made % estimates *n 
eve-y case; r = .67^ 
\ « .50 
• p < .JO 
•* p < .05 
p ^.0\ 



